Server-processor hybrid system for processing data

ABSTRACT

The present invention relates to a server-processor hybrid system that comprises (among other things) a set (one or more) of front-end servers (e.g., mainframes) and a set of back-end application optimized processors. Moreover, implementations of the invention provide a server and processor hybrid system and method for distributing and managing the execution of applications at a fine-grained level via an I/O-connected hybrid system. This method allows one system to be used to manage and control the system functions, and one or more other systems to co-processor.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is related in some aspects to commonly owned andco-pending patent application number (to be provided), entitled“PROCESSOR-SERVER HYBRID SYSTEM FOR PROCESSING DATA”, assigned attorneydocket number END920070376US1, filed Nov. 15, 2007, the entire contentsof which are herein incorporated by reference. This application isrelated in some aspects to commonly owned and co-pending patentapplication Ser. No. 11/877,926, entitled “HIGH BANDWIDTH IMAGEPROCESSING SYSTEM”, assigned attorney docket number END920070398US1,filed Oct. 24, 2007, the entire contents of which are hereinincorporated by reference. This application is related in some aspectsto commonly owned and co-pending patent application Ser. No. 11/767,728,entitled “HYBRID IMAGE PROCESSING SYSTEM”, assigned attorney docketnumber END920070110US2, filed Jun. 25, 2007, the entire contents ofwhich are herein incorporated by reference. This application is alsorelated in some aspects to commonly owned and co-pending patentapplication Ser. No. 11/738,723, entitled “HETEROGENEOUS IMAGEPROCESSING SYSTEM”, assigned attorney docket number END920070110US1,filed Apr. 23, 2007, the entire contents of which are hereinincorporated by reference. This application is also related in someaspects to commonly owned and co-pending patent application Ser. No.11/738,711, entitled “HETEROGENEOUS IMAGE PROCESSING SYSTEM”, assignedattorney docket number END920070111US1, filed Apr. 23, 2007, the entirecontents of which are herein incorporated by reference.

FIELD OF THE INVENTION

The present invention generally relates to data processing.Specifically, the present invention relates to a server-processor hybridsystem for more efficient data processing.

BACKGROUND OF THE INVENTION

Web 1.0 is historically referred to as the World Wide Web, which wasoriginally about connecting computers and making technology moreefficient for computers. Web 2.0/3.0 is considered to encompass thecommunities and social networks that build contextual relationships andfacilitate knowledge sharing and virtual web servicing. Traditional webservice can be thought of as a very thin client. That is, a browserdisplays images relayed by a server, and every significant user actionis communicated to the front-end server for processing. Web 2.0 is asocial interaction that is consisted of the software layer on theclient, so the user gets quick system response. The back-end storage andretrieval of data is conducted asynchronously in the background, so theuser doesn't have to wait for the network. Web 3.0 is geared towards the3 dimensional vision such as in virtual universes. This could open upnew ways to connect and collaborate using 3D shared. Along these lines,web 3.0 describes the evolution of Web usage and interaction alongseveral separate paths. These include transforming the Web into adatabase, a move towards making content accessible by multiplenon-browser applications.

Unfortunately, the traditional server cannot efficiently handle thecharacteristics of Web 3.0. No existing approach addresses this issue.In view of the foregoing, there exists a need for an approach thatsolves this deficiency.

SUMMARY OF THE INVENTION

The present invention relates to a server-processor hybrid system thatcomprises (among other things) a set (one or more) of front-end servers(e.g., mainframes) and a set of back-end application optimizedprocessors. Moreover, implementations of the invention provide a serverand processor hybrid system and method for distributing and managing theexecution of applications at a fine-grained level via an I/O-connectedhybrid system. This method allows one system to be used to manage andcontrol the system functions, and one or more other systems to serve asa co-processor or accelerator for server functions.

The present invention allows the front-end server management and controlsystem components to be reused, and the applications such as virtual webor game processing components to be used as an accelerator orco-processor. The system components can be run using different operatingsystems. The front-end server(s) acts as a normal transaction basedcomputing resource, but for which these transactions may be the triggerfor large computationally intense graphics, rendering or otherfunctions. The processor is placed at the back-end to handle suchfunctions. In addition to traditional transaction processing, thefront-end server(s) would also perform specific processor selectionfunctions, and set-up, control and management functions of the cellco-processors.

A first aspect of the present invention provides a server-processorhybrid system for processing data, comprising: a set of front-endservers for receiving the data from an external source; a set ofback-end application optimized processors for receiving the data fromthe set of front-end servers, for processing the data, and for returningprocessed data to the set of front-end servers; and an interface withinat least one of the set of front-end servers having a set networkinterconnects, the interface connecting the set of front-end serverswith the set of back-end application optimized processors.

A second aspect of the present invention provides a method forprocessing data, comprising: receiving the data from an external sourceon a front-end server; sending the data from the front-end server to aback-end application optimized processor via an interface having a setof network interconnects, the interface being embodied in server;processing the data on the back-end application optimized processor toyield processed data; and receiving the processed data from the back-endapplication optimized processor on the front-end server.

A third aspect of the present invention provides a method for deployinga server-processor hybrid system for processing data, comprising:providing a computer infrastructure being operable to: receive the datafrom an external source on a front-end server; send the data from thefront-end server to a back-end application optimized via an interfacehaving a network interconnects, the interface being embodied in thefront-end server; process the data on the back-end application optimizedprocessor to yield processed data; and receive the processed data fromthe back-end application optimized processor on the front-end server.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of this invention will be more readilyunderstood from the following detailed description of the variousaspects of the invention taken in conjunction with the accompanyingdrawings in which:

FIG. 1 shows box diagram depicting the components of theserver-processor hybrid system according to the present invention.

FIG. 2A shows a more detailed diagram of the system of FIG. 1 accordingto the present invention.

FIG. 2B shows a more specific diagram of the back-end applicationoptimized processors(s) of the hybrid system according to the presentinvention.

FIG. 3 shows communication flow within the server-processor hybridsystem according to the present invention.

FIGS. 4A-D shows a method flow diagram according to the presentinvention.

The drawings are not necessarily to scale. The drawings are merelyschematic representations, not intended to portray specific parametersof the invention. The drawings are intended to depict only typicalembodiments of the invention, and therefore should not be considered aslimiting the scope of the invention. In the drawings, like numberingrepresents like elements.

DETAILED DESCRIPTION OF THE INVENTION

As indicated above, the present invention relates to a server-processorhybrid system that comprises (among other things) a set (one or more) offront-end servers (e.g., mainframes) and a set of back-end applicationoptimized processors. Moreover, implementations of the invention providea server and processor hybrid system and method for distributing andmanaging the execution of applications at a fine-grained level via anI/O-connected hybrid system. This method allows one system to be used tomanage and control the system functions, and one or more other systemsto serves as a co-processor or accelerator.

The present invention allows the front-end server management and controlsystem components to be reused, and the applications such as virtual webor game processing components to be used as an accelerator orco-processor. The system components can be run using different operatingsystems. The front-end server(s) acts as a normal transaction basedcomputing resource. These transactions may be the trigger for large,computationally intense graphics, renderings, numerically intensivecomputations, or other functions. The processor is placed at theback-end to handle such functions. In addition to traditionaltransaction processing, the front-end server(s) would also performspecific processor selection functions, and set-up, control andmanagement functions of the co-processors. It should be understood thatas used herein, the term data can mean any type of data such as“multi-modal” data, e.g., video and/or data streams, predefined blocklengths, text, graphics, picture formats, xml, html etc. Having theserver at the front-end of the hybrid system provides (among otherthings) good at high transaction throughput, and cell processor workloadmanagement, cell processor resource management.

Referring now to FIG. 1, a logical diagram according to the presentinvention is shown. In general, the present invention provides aserver-processor hybrid system 11 that comprises a set (one or more) offront-end servers 12 and a set of back-end application optimizedprocessors (referred to herein as processors for brevity) 20. As shown,each server 12 typically includes infrastructure 14 (e.g., email, spam,firewall, security, etc.), a web content server 16, and portal/front-end17 (e.g., an interface as will be further described below). Applications19 and databases 18 are also hosted on these servers. Along these linesserver(s) 12 are typically System z servers that are commerciallyavailable from IBM Corp. of Armonk, N.Y. (System z and related terms aretrademarks of IBM Corp. in the United States and/or other countries).Each processor 20 typically includes one or more application functionaccelerators 22, and one or more database function accelerators 24.Along those lines, processor(s) 20 are typically cell blades that arecommercially available from IBM Corp. (cell, cell blade and relatedterms are trademarks of IBM Corp in the United States and/or othercountries). Moreover, processor(s) 20 are optimized based on theapplications 19 that are running so that performance is optimal andefficient. As shown, server 12 receives data from an external source 10via typically communication methods (e.g., LAN, WLAN, etc.). Such datais communicated to processor 20 for processing via an interface ofserver 12. Processed data can then be stored and/or returned to server12 and onto external source 10. As depicted, server 12 represents thefront-end of hybrid system 11 while processor 20 represents theback-end.

This system is further shown in FIGS. 2A-B. FIG. 2A shows externalsource(s) 10 communicating server(s) 12, which communicates withprocessor(s) 20 via interface 23. Typically, interface 23 is aninput/output (I/O) cage embodied/contained within each server 12.Interface 23 also includes a set of network interconnects such asexpress peripheral component interconnects (PCIs) 25. Interface 23 mayalso include other components as indicated in the above-incorporatedpatent applications.

In any event, data will be received from external source(s) 10 onprocessor(s) 20 and communicated to server(s) via interface(s) 23. Oncereceived, processor(s) 20 will process the data and return the processeddata to server(s) 12, which can return the same to external source(s)10. Processor(s) 20 can also leverage staging storage and processed datastorage devices to store the original data and/or the processed data. Asshown in FIG. 2B, each processor 20 typically includes a powerprocessing element (PPE) 30, an element interconnect bus (EIB) 32coupled to the PPE 30, and a set (e.g., one or more but typically aplurality) of special purpose engines (SPEs) 34. The SPEs share the loadfor processing the data.

Referring briefly to FIG. 3, a more specific diagram showing thecomponents' placement within hybrid system 11 is shown. As depicted,server(s) 12 receive/send data from external sources A and B, and routethat data to processor(s) 20 for processing. After such processing,processed data is returned to server(s) 12, and to external sources Aand B. Also present in hybrid system 11 is staging storage device 36 andprocessed data storage device 38. Staging storage device 36 can be usedto store data prior to, during and/or after being processed, whileprocessed data storage device can be used to store processed data.

Referring now to FIGS. 4A-D, a flow diagram of an illustrative processaccording to the present invention will be described. For brevitypurposes, for the remainder of the Detailed Description of theInvention, server 12 is referred to as “5”, while processor 20 isreferred to as “C”. In step S1 external source (A) makes a connectionrequest. In step S2, the connection request is passed on to C aftervalidation by server S. In step S3, C accepts connection, S informs A ofconnection setup completeness. In step S4 stream P arrives from A atserver S. S performs P′=T(P) where T is a transformation function onstream P. In step S5, S can save the data in storage and/or pass it toanother device. In step S6, output bytes are continuously passed onto C.In step S7, C performs P″=U(P′) where U is transformation functionperformed by C. In step S8, P″ is routed to back to S. S performsP³=V(P″) where V is a transformation function performed by server S instep S9. In step S10, P³ is routed continuously to B or A. Additionally,in step S10, A presents connection termination packet (E). In step S11,S receives E and in S12 S inspects E. In step S13, it is determined thatE is a connection termination packet. In step S14, input sampling andcomputation stops. In step S15, S informs C of stream completion. Instep S16, C stops computation. In step S17, C informs S of computationtermination. In step S18, S informs B of connection termination. In stepS19, S acknowledges A of computation completion.

Although not separately shown in a diagram, the following is an exampleof another control flow made possible under the present invention. Thiscontrol flow is useful in scenarios where requests are made directly byS to C without data being sourced from A or redirected to B.

-   -   1. S makes connection request    -   2. Is the connection request valid? (performed by C)    -   3. If yes, accepted by C    -   4. Stream P arrives from S at Processor C (P can also just be        “block” input with a predefined length)    -   5. C performs T(P) where T is a transformation function on        stream P    -   6. T(P) Output bytes are continuously passed back to S    -   7. S encounters End-of-File or End of Stream    -   8. S presents connection termination packet (E)    -   9. C inspects E    -   10. Is E a connection termination packet?    -   11. If Yes, stop sampling inputs, stop computation on C    -   12. C acknowledges S on computation termination

Under the present invention, both a push model and a pull model can beused. Control messages can be sent across a separate control path withdata messages being sent over the regular data path. Here two separateconnection IDs are needed. Control messages can also be sent along withdata messages across the same path. In this case, only one connection IDis needed. Both Push and Pull models can be realized for separate orunified data path and control path. The push model is useful for shortdata where latency is a concern. Control messages usually have latencybounds for data transfer. This requires engagement of the data sourcecomputer processor until all the data is pushed out. The pull model isusually useful for bulk data where the destination computer can readdata directly from the source's memory without involving the source'sprocessor. Here the latency of communicating the location and size ofthe data from the source to the destination can easily be amortized overthe whole data transfer. In a preferred embodiment of this invention,push and pull model can be invoked selectively depending on the lengthof data to be exchanged.

The following steps show how the push and pull models works: DynamicModel Selection

-   -   (1) S and C want to communicate. Sender (S or C) makes the        following decisions—        Step 1—Is data of predefined length and less than Push Threshold        (PT)?        Step 2—If yes, then employ “push”        Step 3—if no, then data is of streaming nature without any known        size. S “shoulder taps” C without location address of data.        Push Threshold (PT) is a parameter that can be chosen for a        given application or data type (fixed length or stream) by the        designer of the system.

Push Model

S shoulder taps C with data block size (if known).

S looks up application communication rate requirements (R).

S looks up # of links in “link aggregation pool” (N).

S matches R and N by expanding or shrinking N [dynamic allocation].

S and C agree on number of links required for data transfer

S pushes data to C.

S can close connection in the following ways—when all data is sent (sizeknown) & when job is complete.

S closes connection by shoulder tap to C.

Pull Model

S shoulder taps C with data block size (if known).S looks up application communication rate requirements (R).S looks up # of links in “link aggregation pool” (N).S matches R and N by expanding or shrinking N [dynamic allocation].S and C agree on number of links required for data transferC pulls data from S memory.S can close connection in the following ways—when all data is sent (sizeknown) & when job is complete.S closes connection by shoulder tap to C

In FIG. 3, server 12 (“S”) and processor 20 (“C”) share access tostaging storage device 36. If S needs to transfer dataset D to C thenthe following steps must happen—(i) S must read D and (ii) transfer D toC over link L. Instead, S can inform C of the name of the dataset and Ccan read this dataset directly from 36. This possible because S and Cshare staging device 36. The steps required for this are listed asfollows (again, for brevity “S” and “C” are used to refer to server 12and processor 20, respectively)—

Step 1—S provides dataset name & location (dataset descriptor) alongcontrol path to C. This serves as “shoulder tap”. C receives thisinformation by polling for data, “pushed” from S.

Step 2—C reads data from D using dataset descriptor.

Step 1—Push or pull implementation possible.

Step 2—Pull or push implementation possible.

Step 1 (push)—“Control Path”

-   -   S shoulder taps (writes to) C with dataset name & location (if        known).

Step 1 (pull)—“Control Path”

-   -   S shoulder taps C with data block size (if known).    -   C pulls data from S memory.

Step 2 (Pull form)—“Data path”

-   -   Staging storage device 36 stores table with dataset name and        dataset block locations.    -   C makes read request to staging storage device 36 with dataset        name D.    -   staging storage device 36 provides a list of blocks.    -   C reads blocks from staging storage device 36    -   C encounters end of dataset.    -   C closes connection.

Step 2 (push form)—“Data Path”

-   -   Staging storage device 36 stores table with dataset name and        dataset block locations.    -   C makes read request to staging storage device 36 with dataset        name D.    -   storage controller of staging storage device 36 pushes disk        blocks of D directly into memory of C.    -   D closes connection.

The foregoing description of various aspects of the invention has beenpresented for purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formdisclosed, and obviously, many modifications and variations arepossible. Such modifications and variations that may be apparent to aperson skilled in the art are intended to be included within the scopeof the invention as defined by the accompanying claims.

We claim:
 1. A server-processor hybrid system for processing data,comprising: a set of front-end servers configured to receive the datafrom an external source; a set of back-end application optimizedprocessors configured to receive the data from the set of front-endservers, process the data, and return processed data to the set offront-end servers; and an interface within at least one of the set offront-end servers having a set of network interconnects, the interfaceconnecting the set of front-end servers with the set of back-endapplication optimized processors, the interface configured to:communicate the data received from the external source, from the set offront-end servers to the set of back-end application optimizedprocessors by selectively invoking a push model or a pull model, andcommunicate the processed data from the back-end application optimizedprocessors to the set of front-end servers by selectively invoking thepush model or the pull model, wherein the push model is selectivelyinvoked when the data to be transmitted includes a control message, andwherein the pull model is selectively invoked when the data to betransmitted includes bulk data.
 2. The front-end server-processor hybridsystem of claim 1, wherein the interface being an input/output (I/O)cage.
 3. The front-end server-processor hybrid system of claim 1,wherein the interface being embodied each of the set of front-endservers.
 4. The front-end server-processor hybrid system of claim 1,wherein each of the set of back-end application optimized processorscomprising: a power processing element (PPE); an element interconnectbus (EIB) coupled to the PPE; and a set of special purpose engines(SPEs) coupled to the EIB.
 5. The front-end server-processor hybridsystem of claim 4, wherein the set of SPEs being configured to processthe data.
 6. The front-end server-processor hybrid system of claim 1,further comprising a web content server, portal, an application, anapplication accelerator and a database accelerator.
 7. The front-endserver-processor hybrid system of claim 1, further comprising: a stagingstorage device; and a processed data storage device.
 8. A method forprocessing data, comprising: receiving the data from an external sourceon a front-end server; sending the data from the front-end server to aback-end application optimized processor via an interface embodied inthe front-end server, the interface having a set of networkinterconnects by selectively invoking a push model or a pull model,wherein the push model is selectively invoked when the data to betransmitted includes a control message, and wherein the pull model isselectively invoked when the data to be transmitted includes bulk data;processing the data on the back-end application optimized processor toyield processed data; and receiving the processed data from the back-endapplication optimized processor on the front-end server.
 9. The methodof claim 8, wherein the interface being an input/output (I/O) cage. 10.The method of claim 8, wherein the back-end application optimizedprocessor comprising: a power processing element (PPE); an elementinterconnect bus (EIB) coupled to the PPE; and a set of special purposeengines (SPEs) coupled to the EIB.
 11. The method of claim 8, whereinthe set of SPEs being configured to process the data.
 12. The method ofclaim 8, further comprising a web content server, portal, anapplication, an application accelerator and a database accelerator. 13.A method for deploying a server-processor hybrid system for processingdata, comprising: providing a computer infrastructure being operable to:receive the data from an external source on a front-end server; send thedata from the front-end server to a back-end application optimizedprocessor via an interface embodied in the front-end server, theinterface having a set of network interconnects by selectively invokinga push model or a pull model, wherein the push model is selectivelyinvoked when the data to be transmitted includes a control message, andwherein the pull model is selectively invoked when the data to betransmitted includes bulk data; process the data on the back-endapplication optimized processor to yield processed data; and receive theprocessed data from the back-end application optimized processor on thefront-end server.
 14. The method of claim 13, wherein the interfacebeing an input/output (I/O) cage.
 15. The method of claim 13, whereinthe interface being embodied in at least one of the set of front-endservers.
 16. The method of claim 13, wherein the back-end applicationoptimized processor comprising: a power processing element (PPE); anelement interconnect bus (EIB) coupled to the PPE; and a set of specialpurpose engines (SPEs) coupled to the EIB.
 17. The method of claim 14,wherein the set of SPEs being configured to process the data.
 18. Themethod of claim 13, further comprising: a staging storage device; and aprocessed data storage device.
 19. The method of claim 13, furthercomprising a web content server, portal, an application, an applicationaccelerator and a database accelerator.